An experimental analysis of the dependence among codeword bit errors in ECOC learning machines
نویسندگان
چکیده
One of the main factors affecting the effectiveness of Error Correcting Output Coding (ECOC) methods for classification is the dependence among the errors of the computed codeword bits. We present an extensive experimental work for evaluating the dependence among output errors of the decomposition unit in ECOC learning machines. In particular, we apply measures based on mutual information to compare the dependence of ECOC Multi-Layer Perceptron (ECOC MLP), made up by a single multi-input multi-output MLP, and ECOC ensembles made up by a set of independent and parallel dichotomizers (ECOC PND). Moreover, the experimentation analyzes the relationship between the architecture, the dependence among output errors and the performances of ECOC learning machines. The results show that the dependence among computed codeword bits is significantly smaller for ECOC PND, pointing out that ensembles of independent parallel dichotomizers are better suited for implementing ECOC classification methods. The experimental results suggest new architectures of ECOC learning machines to improve the independence among output errors and the diversity between base learners.
منابع مشابه
Dependence among Codeword Bits Errors in ECOC Learning Machines: An Experimental Analysis
One of the main factors affecting the effectiveness of ECOC methods for classification is the dependence among the errors of the computed codeword bits. We present an extensive experimental work for evaluating the dependence among output errors of the decomposition unit of ECOC learning machines. In particular, we compare the dependence between ECOC Multi Layer Perceptrons (ECOC monolithic), ma...
متن کاملQuantitative Evaluation of Dependence among Outputs in ECOC Classifiers Using Mutual Information Based Measures
In previous work, it has been experimentally shown that the implementation of Error Correcting Output Coding (ECOC) classification methods with an ensemble of parallel and independent non linear dichotomizers (ECOC PND) outperforms the implementation with a single monolithic multi layer perceptron (ECOC MLP). This result was ascribed to the higher effectiveness of error correcting output coding...
متن کاملLearning Distributed Linguistic Classes
Error-correcting output codes (ECOC) have emerged in machine learning as a successful implementation of the idea of distributed classes. Monadic class symbols are replaced by bit strings, which are learned by an ensemble of binary-valued classifiers (dichotomizers). In this study, the idea of ECOC is applied to memory-based language learning with local (knearest neighbor) classifiers. Regressio...
متن کاملClassification of EEG-based motor imagery BCI by using ECOC
AbstractAccuracy in identifying the subjects’ intentions for moving their different limbs from EEG signals is regarded as an important factor in the studies related to BCI. In fact, the complexity of motor-imagination and low amount of signal-to-noise ratio for EEG signal makes this identification as a difficult task. In order to overcome these complexities, many techniques such as variou...
متن کاملStudying empirical correlation between drilling specific energy and geo-mechanical parameters in an oil field in SW Iran
Multiplicity of the effective factors in drilling reflects the complexity of the interaction between rock mass and drilling bit, which is followed by the dependence of parameters and non-linear relationships between them. Rock mass or, in other words, the formation intended for drilling, as the drilling environment, plays a very essential role in the drilling speed, depreciation of drilling bit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neurocomputing
دوره 57 شماره
صفحات -
تاریخ انتشار 2004